Skip to content

fix(parser): allow Kinesis envelopes to handle non-JSON strings #3531

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jan 27, 2025

Conversation

dreamorosi
Copy link
Contributor

Summary

Changes

Please provide a summary of what's being changed

This PR updates the implementation of both the Kinesis Data Stream and Kinesis Firehose envelopes so that they don't make assumptions about the contents of the data and instead let the customer apply transforms via the schema provided.

The PR also exports the DynamoDBStreamToKinesisChangeRecord so that customers can extend the schema for events coming from Kinesis Data Streams that contain DynamoDB Stream events.

Please add the issue number below, if no issue is present the PR might get blocked and not be reviewed

Issue number: #3530


By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

@dreamorosi dreamorosi self-assigned this Jan 25, 2025
@dreamorosi dreamorosi requested a review from a team January 25, 2025 18:07
@dreamorosi dreamorosi requested a review from a team as a code owner January 25, 2025 18:07
@boring-cyborg boring-cyborg bot added parser This item relates to the Parser Utility tests PRs that add or change tests labels Jan 25, 2025
@pull-request-size pull-request-size bot added the size/XL PRs between 500-999 LOC, often PRs that grown with feedback label Jan 25, 2025
@github-actions github-actions bot added the bug Something isn't working label Jan 25, 2025
@dreamorosi dreamorosi linked an issue Jan 25, 2025 that may be closed by this pull request
Copy link
Contributor

@am29d am29d left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, another bug closed!

@am29d am29d merged commit d18e03d into main Jan 27, 2025
38 checks passed
@am29d am29d deleted the fix/parser_kinesis_envelopes branch January 27, 2025 08:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working parser This item relates to the Parser Utility size/XL PRs between 500-999 LOC, often PRs that grown with feedback tests PRs that add or change tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bug: Kinesis envelopes assume data is always a JSON
2 participants